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Cost  as  an  independent  variable  is  a  key  tool  In  the  thrust  to  reduce  total 
ownership  cost  for  defense  systems.  While  the  need  for  CAIV  Is  driven  by  cost 
constraints,  success  relies  upon  identification  and  use  of  viable  performance, 
cost,  schedule,  and  risk  “trade  space.”  The  Air  Force  has  integrated  CAIV 
concepts  with  those  In  the  Reduction  In  Total  Ownership  Program  (R-TOC), 
and  has  published  a  comprehensive  guidebook  for  better  understanding. 


The  Defense  System  Affordability 
Council  (DSAC)  Strategic  Plan  es¬ 
tablished  Goal  2  to  lower  the  total 
ownership  cost  (TOC)  of  defense  prod¬ 
ucts.  The  plan  further  established  separate, 
aggressive  objectives  under  that  goal  for 
systems  in  acquisition  and  fielded  sys¬ 
tems.  These  goals  are  further  emphasized 
in  the  draft  new  DoD  5000.1  and  2. 

To  provide  a  focal  point  on  all  reduc¬ 
tion  in  TOC  (R-TOC)  efforts,  encompass¬ 
ing  weapon  system,  infrastructure,  and 
indirect  dimensions,  the  Air  Force  estab¬ 
lished  an  R-TOC  program  office  (SAF/ 
AQXT).  SAF/AQXT  and  the  authors  colla¬ 
borated  to  publish  the  R-TOC  Guidebook, 


which  integrated  Cost  as  an  Independent 
Variable  (CAIV)  and  a  comprehensive  R- 
TOC  process  for  fielded  systems  (1999). 
The  R-TOC  process  relies  on  baselining 
operating  and  support  costs,  identifying 
TOC  drivers,  and  identifying  R-TOC 
opportunities.  CAIV  drives  system  design 
decisions  by  providing  comprehensive 
information  on  alternatives  and  impacts. 

Whereas  CAIV  and  the  R-TOC  process 
have  many  principles  in  common,  CAIV 
exerts  the  most  leverage  when  it  influences 
system  design  and  the  R-TOC  process  is 
most  effective  on  fielded  systems.  The 
relationship  is  shown  in  Figure  1 . 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 

1.  REPORT  DATE 

2QQQ  2.  REPORT  TYPE 

4.  TITLE  AND  SUBTITLE 

Cost  as  an  Independent  Variable:  Principles  and  Implementation 


6.  AUTHOR(S) 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Space  &  Missile  Systems  Center, Acquisition  Support  Team, Los  Angeles 
AFB,CA, 90245 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Acquisition  Review  Quarterly,  Fall  2000 

14.  ABSTRACT 

15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

18.  NUMBER 

19a.  NAME  OF 

ABSTRACT 

OF  PAGES 

RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

20 

3.  DATES  COVERED 

00-00-2000  to  00-00-2000 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 


Standard  Form  298  (Rev.  8-98} 

Prescribed  by  ANSI  Std  Z39-18 


Aiquisition  Review  Quarterly — Fall  2000 


IV  \ 

R-TOC 

Process 

CA 

0 

1 

II 

III  (Fielded  system) 

Program  phase 


Figure  1 .  R-TOC/CAIV  Effectiveness 


CAIV  Construct 


CAIV  is  a  key  strategy  for  implement¬ 
ing  R-TOC  in  the  acquisition  process,  and 
is  particularly  effective  during  system 
development.  Air  Force  Instruction  (AFI) 
10-601  (1998)  defines  CAIV  as  “the  pro¬ 
cess  of  using  better  business  practices, 
allowing  trade  space  for  industry  to  meet 
user  requirements,  and  considering  opera¬ 
tions  and  maintenance  costs  early  in 
requirements  definition  in  order  to  procure 
systems  smarter  and  more  efficiently.” 

CAIV  is  founded  upon  two  primary 
principles:  First,  system  costs  are  con¬ 
strained.  Whereas  some  programs  do  ob¬ 
tain  additional  funding  when  needed,  such 
funding  is  often  at  the  expense  of  other 


programs  or  future  modernization.  Sec¬ 
ond,  “trade  space”  is  the  foundation  for 
smart  decisions.  Trade  space  is  the  range 
of  alternatives  available  to  decision  mak¬ 
ers.  It  is  four-dimensional,  comprising 
performance,  cost  (TOC),  schedule,  and 
risk  impacts. 

The  Air  Force  established  a  set  of  tenets 
that  are  core  to  CAIV  implementation. 
The  concept  of  well-understood  trade 
space  is  the  capstone  tenet  that  enables 
decisions  critical  to  meeting  user  needs 
while  reducing  TOC.  The  remaining  five 
tenets  are  the  pillars  that  enable  trade 
space  to  be  defined  and  exploited.  Figure 
2,  the  CAIV  model,  depicts  the  relation¬ 
ship  of  the  CAIV  tenets. 
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Capabilities-  Partnering  TOC/LCC  Risk-based  Measurement 

based  and  focus  management 

requirements  incentives 


Figure  2.  CAIV  Model 


Trade  Space 


CAIV  provides  better  support  for  criti¬ 
cal  decisions  by  identifying  viable  perfor¬ 
mance,  schedule,  cost  (TOC),  and  risk 
trade  space.  Identification  and  use  of 
viable  trade  space,  or  the  range  of  alter¬ 
natives,  with  full  knowledge  of  real  and 
potential  impacts,  is  essential  for  making 
the  right  decisions  to  meet  user  needs 
while  reducing  TOC.  CAIV  employs  a 
hierarchy  of  cost  reduction  opportunities 
and  tradeoffs  to  meet  aggressive  cost  tar¬ 
gets,  first  looking  to  improve  acquisition 
and  sustainment  efficiencies,  then  scruti¬ 
nizing  noncritical  requirements.  Tradeoffs 
of  critical  performance  requirements  are 


only  to  be  addressed  as  a  last  resort,  with 
the  agreement  of  the  Milestone  Decision 
Authority  and  user. 

Trade  space  is  commonly  defined  by 
alternatives  in  terms  of  the  performance, 
cost,  and  schedule  impacts  that  each 
alternative  presents.  Risk  must  also  be 
included  in  two  ways.  First,  risk  is  a  fourth 
dimension  in  the  trade  space,  recognizing 
that  critical  decisions  may  be  driven  by 
the  risks  of  certain  alternatives.  Second, 
risk  actually  “discounts”  the  anticipated 
performance,  cost,  and  schedule  options; 
in  other  words,  it  lessens  the  trade  space 
to  ensure  a  decision  maker  does  not  trade 
away  something  that  may  not  be  attain¬ 
able.  For  example,  assume  you  have  a 
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system  with  anticipated  range  of  2000 
miles  versus  a  requirements  threshold  of 
1500  miles.  You  could  trade  away  up  to 
500  miles  of  range  for  a  fully  tested,  vali¬ 
dated  system  and  still  meet  threshold. 
However,  you  definitely  would  not  trade 
away  500  miles  of  range  at  the  beginning 
of  program  definition  and  risk  reduction 
(PDRR),  when  there  are  potential  weight 
growths,  fuel  consumption  increases,  etc. 

Figure  3  portrays  the  cost-performance 
trade  space  for  a  key  performance  param¬ 
eter  (KPP),  characterized  hy  threshold  and 
ohjective  values.  Note  that  Figure  3  shows 
a  “risk  reserve”  line  to  depict  the  amount 
that  the  trade  space  is  restricted,  to  pre¬ 
vent  trading  away  what  is  not  yet  realized. 
The  “solution  set”  line  represents  the 


optimum  cost-performance  comhinations: 
Points  in  the  shaded  region  are  solutions, 
hut  for  any  given  point,  either  more  per¬ 
formance  for  the  same  cost  or  the  same 
performance  for  less  cost  is  possible. 

The  trade  space  is  of  course  multidi¬ 
mensional,  corresponding  to  the  number 
of  KPPs.  Tradeoffs  can  be  performed  at 
many  levels.  In  the  example  above,  where 
a  KPP  is  involved,  the  user  must  agree  to 
the  tradeoff.  When  a  contractor  has  con¬ 
figuration  control  below  the  “A  Spec,” 
then  the  contractor  can  make  tradeoff 
decisions  as  long  as  the  A  Spec  is  met. 
The  key  is  that  the  decision  maker  must 
fully  understand  impacts  on  the  other  ele¬ 
ments,  especially  cost  (TOC),  in  the  trade 
space. 


Solution 

a>  0) 


Figure  3.  Cesl-Perfermance  Trade  Space 
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Capabilities-Based  Requirements 


CAIV  relies  upon  capability-based  re¬ 
quirements.  Implementation  requires  the 
user  to  define  capability-based  require¬ 
ments,  stating  what  the  system  needs  to 
do  instead  of  how  to  build  the  system  and 
how  subsystem  allocations  are  made.  Such 
definition  allows  the  system  development 
team  flexibility  to  define  a  best-value  sys¬ 
tem  meeting  user  requirements.  This  re¬ 
quires  the  development  of  operationally- 
oriented  performance  requirements  with 
a  minimum  number  of  KPPs.  Require- 
ments-setting  authorities  must  take  special 
efforts  to  exclude  requirements  not  direct¬ 
ly  contributing  to  user  needs.  Prioritizing 
requirements  helps  exclude  nonessential 
requirements  while  helping  system  devel¬ 
opers  maximize  use  of  the  trade  space  by 
focusing  on  characteristics  contributing 
most  to  mission  accomplishment. 

The  requirements  process  specifies  that 
system  requirements  be  reviewed  at  each 
milestone  and  revised  as  needed.  But  sys¬ 
tem  performance  thresholds  defined  at 
Milestone  I  (MS  I),  prior  to  Phase  I  trade 
studies,  may  be  difficult  to  change  in  later 
reviews.  That  is  the  most  important  rea¬ 
son  for  introducing  the  cost  dimension 
into  the  requirements-setting  process  as 
early  as  possible.  Beginning  with  realis¬ 
tic  and  feasible  levels  of  requirements, 
within  the  best  available  measures  of  cost 
estimation,  provides  the  ability  to  identi¬ 
fy  a  realistic  performance  requirements 
baseline.  Through  CAIV  trades,  the  pro¬ 
gram  can  take  advantage  of  alternative 
approaches  and  designs  to  achieve  higher 
levels  of  performance  at  the  same  or  low¬ 
er  levels  of  cost  as  more  information  al¬ 
lows  cost  estimates  to  become  more 
refined  and  accurate.  Staying  flexible  in 


the  finalization  of  requirements  is  impor¬ 
tant,  as  emphasized  in  the  draft  new  DoD 
5000.1  and  (2000). 

The  operational  requirements  docu¬ 
ment  (ORD)  I  should  identify  system 
characteristics  and  define  threshold  ranges 
required  for  user  effectiveness  and  be 
treated  as  interim  versus  final.  Warfighters 
and  users  use  mission  effectiveness  and 
cost  performance  analyses  as  key  parts  of 
the  analysis  of  alternatives  (AoA).  When 
the  preferred  ap¬ 
proach  is  iden¬ 
tified,  users  em¬ 
ploy  mission  ef¬ 
fectiveness  ana¬ 
lysis  and  CAIV 
principles  to  set 
initial  weapon 
system  require¬ 
ments,  based  on 
the  best  insight 
available  to  TOC.  As  a  result,  ORD  I 
should  include  TOC  objectives. 

Phase  I  trade  studies  should  provide  re¬ 
quirements- setters  sufficient  insight  to 
TOC/LCC  impacts  for  them  to  set  specific 
threshold  levels  that  ensure  both  mission 
effectiveness  and  affordability.  During 
Phase  I,  the  weapon  system  IPT  uses 
CAIV  to  define  TOC  impacts  and  conduct 
trade  to  refine  requirements  studies  fo¬ 
cused  on  design  and  sustainment.  The 
derived  data  enables  users.  The  IPT  en¬ 
sures  a  continued  ability  to  meet  baseline 
requirements  while  adapting  to  require¬ 
ments  evolutions  that  drive  system  modi¬ 
fications.  Finalization  of  requirements 
from  the  ranges  defined  in  ORD  I  should 
occur  at  this  time.  Both  the  Joint  Strike 
Fighter  (JFS)  and  Advanced  Amphibious 
Assault  Vehicle  (AAAV)  have  employed 
this  evolutionary  approach. 


"Warfighters  and 
users  use  mission 
effectiveness  and 
cost  performance 
anaiyses  as  key 
parts  of  the  anaiysis 
of  aiternatives 
(AoA)." 
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Partnering 


We  can  no  longer  allow  the  sequential, 
isolated  approach  to  developing  systems ! 
CAIV  relies  on  partnered  management  of 
the  trade  space  between  the  user,  acquirer, 
and  industry  participants,  including  strong 
involvement  from  the  sustainment  experts 
in  each  of  the  three  communities. 


In  the  past,  the  all-too-common  pro¬ 
cess  flow  was  sequential,  with  limited 
part-nering.  Under  CAIV,  the  user  defines 
system  requirements,  with  comprehensive 
input  from  sustainers.  In  addition,  the 
acquirer  and  industry  partners  support  the 
user  hy  identifying  and  quantifying  the 
major  risks  and  TOC  drivers,  thereby 
enabling  better  informed  decisions.  The 
acquirer  leads  system  development,  with 
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strong  user  and  sustainer  involvement  on 
potential  trades  identified  by  the  acquirer 
or  industry.  Industry,  under  contractual 
incentives,  allocates  requirements  and 
designs  systems  for  minimized  TOC, 
seeks  lower  cost  and  equally  capable 
aternatives  for  system  elements  under  its 
control,  and  makes  recommendations  for 
elements  not  under  its  control  (based  on 
trade  studies). 

A  key  element  in  CAIV  success  will 
be  the  cost  performance  integrated  prod¬ 
uct  team  (CPIPT).  The  CPIPT  will  com¬ 
plete  cost-performance-schedule  tradeoffs 
leading  to  CAIV-based  cost,  performance, 
and  schedule  objectives.  The  CPIPT,  to 
include  the  user,  must  work  closely  to¬ 
gether  to  agree  on  final  threshold  and  ob¬ 
jective  values  for  cost,  performance,  and 
schedule  parameters  in  preparation  for  the 
milestone  decision  and  completion  of  key 
documentation. 

CAIV-based  threshold  and  objectives 
for  KPPs,  life-cycle  cost  targets,  and  criti¬ 
cal  milestones  become  the  core  drivers  for 
the  subsequent  program.  These  core  pa¬ 
rameters  must  be  consistent  across  the 
ORD,  acquisition  program  baseline 
(APB),  acquisition  strategy,  and  test  and 
evaluation  master  plan  (TEMP)  that  come 
together  beginning  with  MS  I.  The  IPT  and 
CPIPT  remain  active  through-out  the  pro¬ 
gram  life  cycle  up  through  Phase  III,  pro¬ 
duction,  fielding  and  deployment,  and 
operational  support.  The  CPIPT  is  the 
cognizant  group  to  continue  CAIV-based 
cost-performance-schedule  trade-offs,  to 
establish  cost  range  objectives  for  pro¬ 
duction  and  sustainment,  and  to  revise 
performance,  cost,  and  schedule  objectives 
prior  to  each  milestone  decision. 

After  MS  I,  the  contractor  should  be 
a  major  contributor  for  CAIV-based 


analyses  and  tradeoffs.  Solicitations  need 
to  address  life-cycle  cost  and  performance 
objectives  and  request  industry’s  approach 
for  implementing  and  managing  the  CAIV 
process.  The  contractor  and  government 
managers  should  give  consideration  to 
establishing  a  co-chaired  hierarchy  IPT 
structure.  Working  level  IPTs,  formed 
around  critical  subsystems,  report  to  a  man¬ 
agement  IPT  through  a  systems  integration 
IPT. 

The  core  of  the  CAIV  process  is  trade¬ 
offs  conducted  by  the  working  level  IPTs. 
Working  level  IPTs  should  be  given  a  cost 
target  and  chartered  to  conduct  cost-per¬ 
formance  tradeoffs  to  reduce  subsystem 
cost  drivers.  Cost-performance  tradeoffs 
at  the  system  level  depend  directly  on  sub¬ 
system  level  cost  and  performance 
tradeoffs.  The 
number  and  fo¬ 
cus  of  IPTs  will 
change  as  the 
program  ma¬ 
tures  from  de¬ 
velopment  into 
production  and 
operation  and 
sustainment. 

CAIV  relies  on  acceptance  of  higher 
risk  to  aggressively  pursue  a  “best  value” 
system  for  the  user.  Contractors  and  IPTs 
should  be  given  incentives  to  conduct  ef¬ 
fective  and  meaningful  cost  performance 
tradeoffs. 

The  contractor  is  key  in  cost-perfor¬ 
mance  trades.  The  contractor-government 
partnership,  in  which  the  customer  em¬ 
ploys  prudent  risk  management  and  par¬ 
ticipates  fully  in  the  development  of  the 
confidence  needed  to  entrust  weapon  sys¬ 
tem  development,  ensures  the  success  of 
the  contractor’s  cost-performance  trades. 


"CAIV  relies  on 
acceptance  of 
higher  risk  to 
aggressiveiy 
pursue  a  "hesi 
vaiue"  system 
for  the  user." 
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This  partnership  is  the  natural  evolution 
of  the  insight-oversight  paradigm. 

Promotions  and  assignment  policies 
must  recognize  and  reward  successes  and 
best  efforts.  Cost-type  contracts  should  in¬ 
clude  an  award  fee  clause  that  shares  cost 
savings  between  the  government  and  con¬ 
tractor.  Incentives  were  a  key  ingredient 
in  the  Peace  Shield  program’s  total  suc¬ 
cess  in  meeting  aggressive  schedule  and 
performance  requirements.' 

The  contractor  shared  40  percent  of  a 
$50  million  incentive  bonus  with  employ¬ 
ees.  The  incentive,  combined  with  an 
integrated  earned  value-metrics-schedule 
system,  superb  partnering  with  the  acqui¬ 
sition  office  and  customer,  and  aggressive 
software  management,  overcame  an  early 
schedule  deficit  to  deliver  a  validated 
system  six  months  early. 

There  are  many  tools  available  to  mo¬ 
tivate  contractors:  competitions  between 
primes,  competition  at  the  component 

breakout  level, 
award  fees, 
award  terms, 
performance 
bonuses,  value 
engineering 
opportunities, 
and  multiyear 
or  sole- source 
awards.  Acquisition  offices  should  address 
incentives  as  part  of  the  CAIV  plan  in¬ 
cluded  in  the  acquisition  strategy.  Contrac¬ 
tors  must  be  encouraged  to  meet  and 
exceed  life-cycle  cost  reduction  targets, 
not  just  near-term  cost  objectives. 

In  order  to  address  life-cycle  costs  up 
front  and  early,  for  example,  continuation 
of  a  multiyear  contract  can  be  tied  to 
reaching  or  exceeding  interim  life-cycle 
cost  targets.  The  contractor  could  receive 


a  larger  percentage  of  the  next  production 
lot  or  could  be  awarded  the  next  phase 
if  production  unit  costs  meet  or  exceed  a 
cost  reduction  profile.  The  objective 
should  be  to  tie  life-cycle  cost  targets  and 
contractor  performance  together  through 
innovative  and  aggressive  incentives. 

TOC/LCC  Focus 


CAIV  requires  all  team  members  main¬ 
tain  focus  on  TOC/LCC.  Fiscal  constraint 
is  a  reality  that  all  Air  Force  stakeholders 
must  recognize.  Based  on  the  determina¬ 
tion  of  resource  availability,  stakeholders 
must  set  an  aggressive  but  realistic  TOC 
target  for  the  system. 

At  each  milestone,  decision  makers  will 
review  targets  and  progress  toward  veri¬ 
fying  that  they  will  be  met.  Cost  targets 
shall  be  addressed  in  the  acquisition  strat¬ 
egy  and  will  be  included  and  tracked  in 
the  acquisition  program  baseline  (APB). 
CAIV-based  cost  targets  should  be  in¬ 
cluded  in  requests  for  proposals  (RFPs) 
and  contractors  given  incentives  to 
achieve  cost  targets.  Also,  all  personnel 
must  constantly  be  cognizant  of  the  need 
to  identify  cost  reduction  opportunities 
and  tradeoffs. 

Typical  targets  for  procurement  and 
sustainment  are  average  unit  procurement 
cost  (AUPC  equals  total  procurement 
funding/total  quantity)  and  average  unit 
O&S  cost  (AUO&SC  equals  unit  cost  per 
flight  hour,  etc.).  Each  of  these  metrics 
can  be  tailored  to  the  specific  system.  Pro¬ 
curement  targets  can  be  expressed  as  a  cost 
profile;  for  example,  AUPC  versus  pro¬ 
duction  lot  number.  Sustainment  targets  may 
be  expressed  as  a  percentage  reduction 
relative  to  O&S  costs  of  a  similar  system. 


"Premeliens  and 
assignment  policies 
must  recognize  and 
reward  successes 
and  best  efforts." 
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Confidence  limits  for  development, 
procurement,  and  sustainment  cost  targets 
will  vary  with  the  phase  of  the  program 
as  well  as  system  complexity  and  the  de¬ 
gree  to  which  it  is  pushing  the  state  of  the 
art.  At  MS  I,  for  example,  development 
cost  estimates  should  he  more  accurate 
than  estimates  for  O&S  costs. 

Estimating  TOC/LCC  poses  a  signifi¬ 
cant  challenge  early  in  the  program,  es¬ 
pecially  for  cutting-edge  programs.  In 
addition,  government  and  industry  have 
sometimes  had  large  variances  in  cost 
estimates,  leading  to  program  start  com¬ 
plications.  SAF/AQ  has  sponsored  a  cost 
estimating  reinvention  team  to  address 
some  of  these  challenges. 

Unfortunately,  TOC/LCC  focus  may 
well  he  the  weakest  link  in  the  CAIV 
process.  The  reality  is  that  instant-year 
dollars  are  politically  and  practically  the 
driving  factor  in  program  decisions.  It  is 
easy  to  say  decision  makers  must  make 
decisions  based  on  TOC  considerations, 
hut  a  lot  harder  to  manage  real  programs 
that  way.  When  we  see  high  payoff  invest¬ 
ments  rejected  in  our  programs,  it  seems 
we  often  manage  hy  the  “modified 
Wimpie  philosophy,”  which  is  not,  “I  will 
gladly  pay  you  on  Tuesday  for  a  ham¬ 
burger  today,”  but  “I  will  gladly  pay  you 
for  three  hamburgers  on  Tuesday  for  a 
hamburger  today !”  While  we  may  bemoan 
such  an  approach,  we  must  realize  that 
without  the  hamburger  today,  we  may 
starve  and  not  reach  Tuesday!  The  only 
way  we  can  overcome  this  malady  is  with 
more  accurate,  believable  tradeoff  data,  so 
that  decision  makers  will  have  a  better 
picture  of  the  true  impact. 


Risk-Based  Management 


Risk  management  is  an  integral  part  of 
CAIV.  It  recognizes  we  cannot  afford  to 
avoid  all  risk,  but  rather  must  manage 
the  critical  risks.  A  comprehensive  and 
disciplined  risk  management  program 
throughout  a  program’s  life  cycle  is  criti¬ 
cal  to  effective  management  to  meet  cost, 
performance,  and  schedule. 

As  established  by  DoD  5000.2-R  (DoD, 
1998)  and  AFMCP  63-101,  the  risk  man¬ 
agement  program  identifies  and  tracks  risk 
drivers,  generates  risk-handling  plans,  and 
provides  for  monitoring  to  track  risk  “re¬ 
tirement”  or  growth.  Risk  reduction  mea¬ 
sures  are  included  in  cost-performance 
tradeoffs,  where  applicable. 

Program  partners  must  jointly  identify, 
analyze,  and  prioritize  critical  program 
risks,  then  periodically  review  handling 
plan  progress. 

Handling  ap¬ 
proaches  can 
run  the  gamut 
from  develop¬ 
ing  alternate  de¬ 
signs  for  critical 
components  to 
simple  monitor¬ 
ing  to  ensure  a 
risk  does  not 
take  root  and  grow.  A  commonly  used  tool 
for  identifying  and  prioritizing  risks  is 
shown  in  Figure  5. 

The  risk  matrix  helps  identify  the  risks 
that  must  be  addressed — those  that  have 
high  probability  of  occurrence  and  poten¬ 
tial  high  impact.  Risk  management  is  not 
just  an  engineering  function!  The  team 
must  address  programmatic  risks  and  all 
functions  must  be  involved  in  the  handling 
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Figure  5.  Risk  Matrix 


plans  as  appropriate.  In  fact,  any  program 
element  associated  with  cost,  schedule, 
and  performance  has  a  direct  interface 
with  the  risk  management  process. 

It  is  important  to  rememher  that  risk 
management  is  used  throughout  a  pro¬ 
gram’s  life  cycle.  A  risk  management  plan 
should  he  part  of  the  early  CAIV  strat¬ 
egy.  Several  programs  have  reaped  ben¬ 
efits  hy  conducting  government-industry 
risk  brainstorming  and  prioritization  ses¬ 
sions  that  directly  influenced  the  RFP 
(e.g..  Space  Lift  Range  Modernization  and 
Satellite  Control  Network  programs).  RFPs 
should  require  offerors  to  identify  their 
risk  management  approach,  risks  inherent 
in  their  design,  and  risk  handling  plans. 

Measurement 


Setting  realistic  but  aggressive  goals  for 
cost  and  performance  is  a  key  element  of 
program  management.  Measuring  progress 


toward  attaining  those  goals  is  a  challeng¬ 
ing  but  critical  element  of  CAIV  imple¬ 
mentation.  Proper  metrics  will  add  value 
by  aiding  decision  making  rather  than  sim¬ 
ply  reporting  status.  Metrics  measure  a 
wide  range  of  parameters,  including  health 
of  critical  processes,  effectiveness  of  cost 
saving  initiatives,  and  status  of  the  “value 
stream.” 

The  earned  value  management  system 
(EVMS)  and  technical  performance  mea¬ 
surements  (TPMs)  provide  particularly 
useful  metrics.  A  contractor  needs  an 
EVMS  to  manage  complex  tasks.  Proper 
partnering  will  provide  government  of¬ 
fices  insight  into  the  EVMS.  TPMs  are 
product  design  and  performance  assess¬ 
ments  that  estimate  values  of  essential 
performance  parameters  of  the  current 
design.  TPMs  assist  in  determining  the  po¬ 
tential  impacts  of  differences  between 
planned  and  actual  values.  Table  1  lists 
other  useful  metrics  and  tools. 
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Table  1.  Illustrative  CAIV  Metrics  and  Features 


Are  cost  objectives  defined 
and  consistent  with  require¬ 
ments  programmed  and 
projected  fiscal  resources? 

•  Out-year  resources  identified?  (doiiars) 

•  Production  and  O&S  cost  objectives  inciuded  in  the 

RFP? 

•  Key  tradeoff  issues  addressed  (e.g.,  in  AoA)? 

Is  the  government  managing 
to  achieve  cost  objectives? 

•  RFP  contains  a  strict  minimum  number  of  performance 
specifications?  (number) 

•  CPiPT  functioning,  tradeoff  space  identified  in  program 
baseiine  and  RFP? 

•  Risks  to  achieve  cost  objectives  identified  and  program 
steps  to  address  these  defined?  (risk  pian  ) 

•  Incentives  for  achieving  iife  cycie  cost  objectives 
inciuded  in  the  RFP  and  contract?  (  percent  reiative 
totai  contract  doiiars;  period  of  performance  tied  to  iife 
cycie  cost  target  profiie) 

•  Mechanism  for  contractor  suggestions  to  reduce 
production  and  O&S  costs  in  piace  and  operating? 

(vaiue  engineering  ciause) 

•  Aiiocation  of  cost  objectives  provided  to  IPTs  and  key 
suppiiers 

•  Measurement  and  estimation  of  reiiabiiity  and  maintain- 
abiiity 

•  Robust  contractor  incentives  pian  in  piace? 

Are  contractors  managing  to 
achieve  cost  objectives? 

•  Provide  appropriate  toois  for  cost-performance  tradeoffs 
(inciuding  incentives)  and  participate  in  cost-perfor¬ 
mance  tradeoff  process  (hierarchy  IPT  structure;  award 
fee  fiow  down  to  iPT  members) 

•  Identifies  and  impiements  new  technoiogies  and  manu¬ 
facturing  processes  that  can  reduce  costs 

•  Identifies  procedurai/process  impediments  to  cost 
reduction  measures 

•  Estabiishes  strong  reiationship  with  vendor  base, 
inciuding  sound  incentives  structure 
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These  examples  reflect  the  degree  to 
which  a  program  is  structured  for  CAIV 
success.  They  provide  important  and  oh- 
servahle  tools  that  assist  in  setting  aggres¬ 
sive  production  and  operating  and  support 
(O&S)  cost  objectives  and  management 
of  the  program.  In  some  cases,  quantita¬ 
tive  metrics  can  he  defined  as  indicated 
hy  the  parentheses  at  the  end  of  a  process 
step. 

CAIV  Evolution  Through 
THE  Life  Cycle 


CAIV  is  initiated  at  the  beginning  of  a 
program  and  evolves  through  the  life 
cycle.  As  an  acquisition  methodology, 
the  application  of  CAIV  varies  between 
each  acquisition  phase  as  performance 
requirements,  initially  established  as  a 
range  between  required  thresholds  and 
desired  objectives,  narrow  as  a  program 
migrates  toward  production.  Let’s  briefly 
examine  the  application  of  CAIV  across 
an  acquisition  life  cycle  using  the  CAIV 
tenets. 

Phase  0 

In  Phase  0,  CAIV  supports  the  analy¬ 
sis  of  alternatives  (AOA)  by  focusing  on 
KPPs  and  cost  drivers.  The  R-TOC  pro¬ 
cess  provides  essential  tools  with  data 

from  existing 
systems  and 
techniques  for 
baselining  cost 
drivers.  At  the 
end  of  this 
phase  the  ORD 
is  established 
with  threshold  and  objective  ranges,  fund¬ 
ing  is  assigned  for  development  (where 


necessary),  and  a  maintenance  strategy  is 
proposed  to  minimize  long-term  O&S. 
Unfortunately,  current  practice  provides 
a  detailed  ORD,  usually  based  on  mission 
effectiveness  analysis,  without  adequate 
assessment  of  TOC  impacts. 

Requirements.  The  highest  Air  Force 
levels  ensure  that  defense  system  effec¬ 
tiveness  is  optimized  within  constraints  of 
available  and  projected  resources.  Also, 
warfighters  and  users  utilize  mission 
effectiveness  and  cost  performance  analy¬ 
ses  as  key  parts  of  the  AoA.  When  the 
preferred  approach  is  identified,  users  em¬ 
ploy  mission  effectiveness  analysis  and 
CAIV  principles  to  set  initial  weapon 
system  requirements,  based  on  the  best 
insight  available  to  total  ownership  cost 
(TOC).  As  a  result,  ORD  I  should  include 
TOC  objectives. 

Partnering.  The  warfighter  and  user 
lead  the  requirements  definition  efforts, 
and  should  have  acquirer  support  if  an 
existing  program  office  or  a  development 
planning  core  team  is  assigned. 

TOC  focus.  The  Phase  0  IPT  focuses 
on  the  life-cycle  aspects  of  a  program  by 
developing  and  recommending  an  opera¬ 
tion  and  sustainment  (O&S)  strategy  that 
will  optimize  the  elements  of  reliability 
and  maintainability.  TOC  focus  recog¬ 
nizes  that  the  majority  of  life-cycle  cost 
is  in  the  O&S  phase,  and  the  resulting 
strategy  will  reflect  a  system  that  both 
maximizes  system  reliability  and  requires 
minimum  downtime  to  fault,  isolate  and 
repair  problems. 

Risk-based  management.  As  much 
acquirer  involvement  as  possible  is  de¬ 
sirable  to  support  the  user  in  gaining  an 
early  understanding  of  potential  risks  and 
handling  alternatives.  In  preparation  for 
Milestone  1 ,  the  acquisition  strategy  must 
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identify  the  key  risk  areas  within  the 
proposed  solution.  These  will  become 
integrated  into  the  CAIV  strategy  and, 
ultimately,  the  RFP. 

Measurement.  Ohjective  TOC  should 
he  set  in  the  ORD.  The  requirements 
“owner”  should  estimate  which  require¬ 
ments  are  likely  to  he  cost  drivers;  and 
for  each  such  driver,  track  whether  ad¬ 
equate  TOC  insight  has  been  gained.  This 
is  hard!  For  that  reason  it  is  essential  that 
users  work  with  financial  experts  within 
acquiring  agencies  to  best  estimate  total 
ownership  costs. 

Phase  I 

Maximum  leverage  for  CAIV  efforts 
exists  in  Phase  I,  since  system  design  has 
not  yet  been  finalized. 

Requirements.  During  Phase  I,  the  wea¬ 
pon  system  IPT  uses  CAIV  to  define  TOC 
impacts  and  conduct  trade  studies  focused 
on  design,  particularly  as  influenced  by 
O&S.  Tradeoff  data  enables  warfighters 
and  users  to  refine  requirements. 

Partnering.  The  team  now  typically  in¬ 
cludes  an  acquisition  program  office  and 
at  least  one  contractor.  The  acquirer  will 
have  the  lead  for  completing  PDRR,  but 
must  ensure  close  coordination  with  the 
user.  Using  CAIV,  the  team  should  base¬ 
line  expectations  through  the  following 
steps: 

•  Identify  common  and  unilateral  ob¬ 
jectives  to  ensure  concerted,  focused 
effort. 

•  Define  all  interdependencies  and  orga¬ 
nize,  plan,  and  commit  to  act  to  meet 
them.  Central  to  this  aspect  is  analysis 
of  the  contractor’s  network  and  criti¬ 
cal  path,  and  integrated  master  plan 


(IMP).  Based  on  this  analysis,  the 
government  should  build  its  own  IMP 
to  ensure  government  action  meets 
timelines  expected  by  the  contractor  and 
does  not  give  any  cause  for  contractor 
claims. 

•  Generate  a  unified  risk  handling  plan. 

•  Develop  a  concept  of  operations 
(CONOPS)  to  define  management  and 
working  level  interaction,  metrics,  etc. 

TOC  focus.  With  a  funded  and  manned 
program,  adequate  effort  can  now  be  ex¬ 
pended  to  identify  TOC  and  risk  impacts 
from  design  and  sustainment  trade  stud¬ 
ies. 

Risk-based  management.  The  team 
should  generate  a  unified  risk-handling 
plan  to  address 
high  and  mod¬ 
erate  risk  areas. 

The  plan  should 
consolidate  pre¬ 
vious  risk  ana¬ 
lyses,  conduct 
further  brain¬ 
storming,  pri¬ 
oritize  risks,  al¬ 
locate  risk-handling  responsibilities,  and 
regularly  review  status.  Implementation 
may  include  provisions  in  acquisition 
strategies,  contracts,  or  parallel  efforts.  As 
a  minimum,  the  contract  should  require 
the  contractor  to  conduct  trade  studies  to 
identify  trade  space. 

Measurement.  The  team  must  con¬ 
tinue  to  track  TOC  estimates  to  TOC  ob¬ 
jectives.  In  addition,  requirements  “own¬ 
ers”  should  continue  to  track  degree  of 
insight  to  TOC  impact  for  each  identified 
cost  driver.  The  team  should  track  risk 
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drawdown  per  the  handling  plans  with 
metrics  tied  to  specific  risk  reduction 
accomplishments.  Use  of  TPMs  can  he 
very  effective  for  such  effort. 

Phase  II 

Early  in  Phase  II,  system  design  freeze 
limits  the  ability  of  CAIV  to  generate  fur¬ 
ther  substantial  cost  savings.  However, 
focus  on  producibility  and  O&S  may  still 
yield  benefits. 

Requirements.  The  IPT  uses  CAIV  to 
ensure  requirements  are  met  at  minimum 
TOC. 

Partnering.  The  team  may  expand  to  in¬ 
clude  other  organizations  (e.g.,  AFOTEC). 
The  same  principles  of  teaming  apply  as 
applied  in  Phase  I. 

TOC  focus.  Tradeoff  studies  will  focus 
on  manufacturing  and  sustainment  im¬ 
pacts  on  TOC  and  risk.  A  mature  design 
and  testing  of  components  and  prototypes 
should  enable  more  accurate  estimates  of 
O&S  impacts  on  TOC. 

Risk-based  management.  The  con¬ 
tract  again  requires  trade  studies  to  iden¬ 
tify  the  “trade  space,”  although  the  abil¬ 
ity  to  make  substantive  changes  decreases 
as  the  design  matures.  The  team  should 
employ  the  same  type  of  risk  program 
definition  as  described  in  Phase  I. 

Measurement.  The  team  continues  to 
track  TOC  estimates  to  TOC  objectives 
and  risk  drawdown  through  TPMs.  In 
addition,  the  contractor  EVMS,  in  con¬ 
junction  with  the  integrated  master  plan 
(IMP)  and  integrated  master  schedule 
(IMS),  provide  accurate  status  for  comple¬ 
tion  of  development  as  well  as  visibility 
to  any  potential  problems  before  they  get 
out  of  hand.  Data  from  prototype  and  com¬ 
ponent  builds  and  testing  will  support  pro¬ 
duction  cost  estimates.  The  team  will  have 


determined  the  availability  and  visibility 
of  such  metrics  during  their  partnering 
sessions. 

Phase  III 

In  Phase  III,  CAIV  can  generate  TOC 
savings  through  production  improvements 
prior  to  delivery  of  finished  systems  to  the 
user.  Eor  fielded  systems,  the  R-TOC 
process  is  primary  in  identifying  cost-sav¬ 
ing  opportunities,  but  the  CAIV  process 
really  starts  all  over  again  in  support  of 
system  modifications. 

Requirements.  The  IPT  ensures  con¬ 
tinued  ability  to  meet  baseline  require¬ 
ments  while  adapting  to  requirements 
evolutions  that  drive  system  modifications. 

Partnering.  Although  some  partners 
may  have  changed  from  earlier  phases 
(especially  if  major  modifications  are  in 
process),  the  same  principles  apply. 

TOC  focus.  With  an  eye  on  reducing 
immediate  costs,  contractors  are  given 
incentives  in  production  contracts  to 
streamline  manufacturing  processes  to 
reduce  the  cost  of  producing  systems. 
Additionally,  all  members  of  the  IPT, 
especially  maintainers,  work  to  ensure 
proposed  sustainment  processes  and 
practices,  maximize  system  availability, 
and  minimize  cost. 

Risk-based  management.  Eor  steady- 
state  systems,  teams  should  focus  on  risks 
that  may  upset  the  steady  state.  Risk 
occurs  in  all  phases  of  acquisition  and  it 
is  constantly  monitored  and  re-examined 
to  ensure  old  risks  are  managed  and  new 
risks  are  identified. 

Measurement.  As  in  previous  phases, 
a  well-functioning  EVMS  along  with 
manufacturing  IMP  and  IMS  provide  the 
IPT  the  necessary  information  to  assess 
program  progress  and  status. 
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Hybrids 

Most  acquisition  programs  consist  of 
modifications  and  ACAT  III  acquisition 
efforts.  One  of  the  most  innovative  aspects 
of  the  revised  acquisition  regulations  is 
the  recognition  that  these  systems  do  not 
need  to  go  through  the  classic  Phase  0, 1, 
II  sequence  before  being  fielded.  In  such 
cases,  the  IPT  should  review  the  above 
guidance  and  synthesize  or  tailor  to  the 
program  at  hand.  As  part  of  the  CAIV  pro¬ 
cess,  IPTs  are  encouraged  to  minimize 
acquisition  times  and  costs  by  stream¬ 
lining  the  acquisition  processes  wherever 
and  whenever  possible. 

Conclusion 


CAIV  is  a  viable  concept  for  attaining 
R-TOC  objectives.  CAIV  and  the  Air 
Force  R-TOC  process  go  hand-in-hand: 
CAIV  primarily  applies  to  systems  in  ac¬ 
quisition  and  the  R-TOC  process  applies 
to  fielded  systems.  Much  of  the  CAIV 
construct  described  here  is  not  new.  Parts 
of  it  have  been  applied  in  numerous  pro¬ 
grams.  The  authors,  and  many  other  pro¬ 
gram  managers,  really  used  key  elements 
of  CAIV  before  they  knew  it  was  CAIV. 
The  construct  presented  here  offers  a  more 
integrated,  definitive  CAIV  implementa¬ 
tion  description  than  has  previously  been 
available.  In  fact,  the  CAIV  construct  pre¬ 
sented  is  more  a  program  management 
construct  than  pure  CAIV. 

Challenges  to  realizing  the  benefits  that 
CAIV  offers  still  exist.  The  greatest  chal¬ 
lenge  is  the  need  to  make  decisions  based 
on  future  impacts  to  break  the  paradigm 
of  continuously  mortgaging  the  future 
when  faced  with  the  reality  of  the  critical 
exigencies  of  today.  That  paradigm  leads 


to  Under  Secretary  of  Defense  (Acquisi¬ 
tion  and  Technology)  Jacques  Gansler’s 
“death  spiral”  (1998).  Improved  under¬ 
standing  and  believable  quantification  of 
TOC  impacts  is  critical  to  overcoming  that 
fate.  The  key  targets  to  enable  better  in¬ 
formation  for  our  decision  makers  fall 
along  the  lines  of  the  CAIV  tenets: 

•  an  improved  requirements  process  to 
focus  on  capabilities-based  require¬ 
ments  supported  by  TOC  impact  data; 

•  improved,  partnered  management  of 
the  trade  space; 

•  recognition  by  every  member  of  the 
user,  acquirer,  and  contractor  team  that 
they  have  an  R-TOC  role  (in  addition, 
improved  cost  estimating  capabilities 
in  government  and  industry); 

•  improved  understanding  and  imple¬ 
mentation  of  risk  management; 

•  better  metrics; 

•  integrating  all  CAIV  aspects  for  effec¬ 
tive  program  management;  and 

•  training  users,  acquirers,  and  contrac¬ 
tors  at  all  levels  on  CAIV  implemen¬ 
tation  so  that  CAIV  becomes  ingrained 
in  the  culture. 

Finally,  CAIV  as  a  term  of  art  should 
disappear  in  the  future — but  everyone 
should  do  it!  In  1991,  a  senior-level  gov¬ 
ernment-industry  team  addressed  the 
problem  of  excessive  engineering  change 
proposals  in  development  by  defining 
Clear  Accountability  in  Design  (CAID). 
CAID  determined  that  the  government 
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would  not  take  configuration  control  be¬ 
low  the  “A  Spec”  until  generally  after 
physical  configuration  audit.  Most  people 


in  acquisition  today  cannot  identify  CAID, 
but  it  is  the  standard.  CAIV  should  go  the 
same  way. 
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Endnote 


1.  The  contract  bid  was  a  $1.1  billion 
effort  for  control  software,  integra¬ 
tion,  test,  and  operational  activation 
of  the  $5  billion  command,  control, 
and  communications  system  for  inte¬ 
grated  air  defense  of  Saudi  Arabia. 
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Appendix 


Risk  Management  Approach 

Let  us  consider  an  example  of  a  poten¬ 
tial  risk  management  approach.  Typically, 
system  weight  is  a  critical  parameter  that 
will  impact  total  system  performance. 
Assume  that  keeping  weight  under  the 
allocated  threshold  is  particularly  vital,  as 
it  usually  is.  Numerous  studies  have  also 
shown  that  weight  typically  grows  through 
development  of  a  system.  Figure  6  shows 
an  allocated  threshold  along  with  “uncer¬ 
tainty  hands”  that  narrow  as  the  design 
matures.  Clearly,  a  tested,  validated  sys¬ 
tem  at  Milestone  (MS)  III  should  he  dis¬ 
tinctly  characterized.  However,  at  Mile¬ 
stone  I,  a  “paper  design”  only  estimates 
system  weight.  Assuming  the  weight 
Technical  Performance  Measure  (TPM) 


will  he  regularly  tracked,  we  can  define 
four  regions  on  the  chart  that  the  TPM  may 
he  in. 

I:  Weight  well  helow  threshold;  high 
confidence  system  will  meet  thresh¬ 
old  at  MS  III. 

II :  Weight  helow  threshold ;  the  closer  to 
the  threshold,  the  more  active  efforts 
must  he  to  contain  growth. 

Ill:  Weight  above  threshold;  need  aggres¬ 
sive  weight  reduction  program. 

IV:  Weight  well  above  threshold;  low 
probability  to  meet  threshold  even 
with  aggressive  program. 
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Cost  Driver  Calcuution 

Figure  7  is  a  simplistic  view  of  a  “comb 
chart”  analysis  of  cost  drivers  for  a  sys¬ 
tem.  The  costs  are  divided  into  RDT&E, 
procurement,  and  O&S.  Each  is  further 
subdivided  into  WBS  elements.  Such  sub¬ 
division  should  go  down  as  far  as  practi¬ 
cable.  Eor  each  element,  dollar  estimates 
and  percentages  of  TOC  are  generated. 
This  analysis  will  provide  a  baseline 


against  which  R-TOC  efforts  are  com¬ 
pared.  Currently,  SAE/AQCT  is  coordi¬ 
nating  10  Air  Eorce  pilot  programs  using 
this  methodology  to  generate  R-TOC 
plans  and  associated  objectives.  We  an¬ 
ticipate  that  this  procedure  will  be  directed 
on  almost  all  programs  in  the  future. 

Directions  for  conducting  such  analysis 
are  in  the  R-TOC  Guidebook  previously 
cited. 
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Figure  7.  Cost  Drivers 


371 


Atquisitiott  Review  Quarterly — Fall  2000 


372 


